How well do doctors think they perform on the General Medical Council's Tests of Competence pilot examinations? A cross-sectional study

OBJECTIVE To investigate how accurately doctors estimated their performance on the General Medical Council's Tests of Competence pilot examinations. DESIGN A cross-sectional survey design using a questionnaire method. SETTING University College London Medical School. PARTICIPANTS 524 medical doctors working in a range of clinical specialties between foundation year two and consultant level. MAIN OUTCOME MEASURES Estimated and actual total scores on a knowledge test and Observed Structured Clinical Examination (OSCE). RESULTS The pattern of results for OSCE performance differed from the results for knowledge test performance. The majority of doctors significantly underestimated their OSCE performance. Whereas estimated knowledge test performance differed between high and low performers. Those who did particularly well significantly underestimated their knowledge test performance (t (196)=-7.70, p<0.01) and those who did less well significantly overestimated (t (172)=6.09, p<0.01). There were also significant differences between estimated and/or actual performance by gender, ethnicity and region of Primary Medical Qualification. CONCLUSIONS Doctors were more accurate in predicating their knowledge test performance than their OSCE performance. The association between estimated and actual knowledge test performance supports the established differences between high and low performers described in the behavioural sciences literature. This was not the case for the OSCE. The implications of the results to the revalidation process are discussed.